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Solving a controllability problem is like answering the question, "how do I get from point 
A to point B?" 

I am serious, the word controllability might sound daunting but the idea is actually 
really simple. Just to show you how the wording can make something so simple so complicated. 
I will first state the problem you are solving in a standard way. Then I will show you a real life 
example of what the statement is really talking about. 

The standard Question: 

Given a system: 

x = Ax + Bu 

y = Cx + Du 

Find the controll input that will drive the system from Xq to Xf. 

Now let's apply this question to a more familiar problem. 

You are at home, and you want to get to work driving your car. How would you need to 
move your steering wheel to get you there? 

Did those two problems sound alike? 

well, let me do a quick translation 

home = Xq 

work = Xf 

system = your car 

moving the steering wheel = driving input 

Basically you are trying to get from point Xq (your home) to x f (final destination, 
work), using a system (car) that looks like this equation: 

x = Ax + Bu 

y = Cx + Du 

What control inputs (ways to move the car) can you apply to the system to get you 

to work? 
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As you can see, people have ways to make things look complicated just so they look 
smarter. 

In our case, we will concentrate on the idea instead of the math. 
Solving this type of problem will tell you 

a) is it possible to go from A to B in certain amount of time? 

b) using this system (our car), how do we get there 

I am making the assumption that if you are reading this paper. You already know 
what this equation means. If you don't, I will write a tutorial on it, perhaps you should read 
that first. 

x = Ax + Bu 
y = Cx + Du 

I also want to note that the purpose of this paper is not to give you all the mathematical 
reasoning behind why things work. This is more like a cook book. It will tell you how to get the 
job done, (specifically in matlab) 



So let's get started. Even though you really should understand the equaltion already I will 
give you a brief definition of what each parameter means. 

x is the state of of the system (how the engine is running) 
x is the how the system is changing 

u is the control input ( how you are controlling the steering wheel) 
y is the output of the system (where the car is going) 

In the first equation 
x = Ax + Bu 



We use A and B to describe how the system is changeing. By knowing the current con- 
dition of our car, and how we are moving the steering wheel, we know how the system (car) is 
changing). If you press on the gas pedal, the engine will go faster for example. 



In the second equation 
y = Cx + Du 
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We use C and D to describe where the system is going. By knowing the current condi- 
toin. and how we are moving the steering wheel we can also find out where the car is going. 
Make sense? 



Controllability Matrix 



The first concept you must be familiar with is this thing called the controllability 

matrix. 

We use the symbol 

Q c = [B AB A 2 B A 3 B A" _1 B] 

to denote this matrix. 

n is the size of the matrix A. 

Let's do a quick example creating the controllability matrix together: 
if we have a system: 

A = ^0 . B = (: 

x = Ax + Bu 

The controllability matrix would then be: 
Q C =[B A J B] 

MO) (;:)(:)] = (::) 

The reason why the controllability matrix is so important is because it tells us the range 
of the output x. 

When we solve for the system of differential equations. 

x = Ax + Bu 



and find x, it would turn out to be a state vector. The outcome for the state vector will 
live inside the range of Q c no matter what input u you put into the equation. 



So if we use the previous example: 
Qc- 
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Range(<2 c ) = i I ~J )a : a is free 
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You can check yourselve that the solution for the system of differential equations will live 
in the (1,1) vector. This is why the controllability matrix is so important. 



Surprisingly, the range of the controllability matrix is the same as the range of this thing 
called Finite time controllability gramian. 



This means that all the solutions for the system differential equations must also live in 
the range of the controllability gramian. 



Controllability gramian 



Let oo > T > 0. The matrix 

P C (T)= J 0 T ' e At V,We A ' l dt 

Is called the finite time controllability gramian of the pair (A,B). 

Some characteristics for the Mr Gramian 
P C (T) is a square matrix 
P C {T) is Hermitian 
P C (T) is positive 
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From the previous section, we claim that the range for the controllability gramian is 
the same as the controllability matrix. 



Range(<3 c ) = Range(P c (T)) 



This might seem like magic, but there is actually a mathematical prove behind this 
madness. It is a messy prove since it involes the Cayley Hamilton stuff. So I will not prove the 
reason why it works. Plus I kinda forgot how to prove it anyway. So take it from me. they are 
the same. 

This will become a very important fact later when we actually solve for the con- 
trollability problem. 



Now let's go over some more definitions you need to know first. 
Controllable subspace: 



If we let A € R nxn and B € ]R nxm in the controolability matrix. A controllable sub- 
space of a matrix Q c is the set of all points y € R™ for which the linear equation: 

Q c v = y 



has a solution v € lR nm 



What a controllable subspace is physically saying is that it is all the place you can 
go. Remember in the beginning of the reading, we discussed how the whole point is to get from 
point A to point B. (Earth to the moon for example) 



y in this case would then be all the places where it is possible to get to under a con- 
trollable condition. 



So what is a contronllable condition? What are the conditions for a system to be 
controllabe? Let's now go over the definition for a controllable system. 



Controllable System 

A LTI system is controllable if and only if for any initial state xq € R n and final 
state Xf £ R™, there is a finite time T > 0 and a control input u denned in the interval [0,T] 
such that: 



x(T) =e AT x 0 + f Q T e A ^ T -^Bu(t)dr 



is equal to Xf. In other word, for any pair (xq ,Xf) of points, there is a control 
input that drives the system from the initial state xq to the final state Xf in finite time T. 
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It is important to note here that a system in controllable if it is capable of going 
from "any" initial to "any" final state in a finite amount of time. It could take a billion years, 
but it is still finite. Finite amount of time also means very very small. 

This means that going to the moon is a uncontrollable system because we cannot 
make it to the moon in 1 second. 

I know it sounds kinda dangerous to sent billion dollar spacecrafts into space 
when we have a uncontrollable system, actually we have ways around that. Although very rarely 
would engineers run into controllable systems, we actually don't need that much control anyway. 

Normally in engineering we use a much less strict test called the controllability 
test. There are many systems that are not controllable but will pass the controllability test. 

The difference between a controllable system and a system that passes the con- 
trollability test is that controllability does not require the system to reach the destination 
in "any" amount of finite time. As long as we get there, we are happy. 

Now let's go through all the tests to see if a system passes the controllability test. 

Algebraic tests for controllability 

If the matrix A is n x n 

1. If the pair (A,B) is controllable 

since controllability is a weaker condition than controllable, if a system is 
controllable, it also passes the controllability test. 

2. Range of Q c = R™ 

3. Rank of Q c = n 

4. Null(Q c ) = {0} 

5. P(T) > 0 for all T>0 

6. PBH test 

Rank[ [XI - A] B] = n for all complex numbers A 

7. Modified PBH test <====== W e use this most of the time 

Rank[ [XI - A] B] = n for all eigenvalues A of A 

8. Suppose that there exists x such that 

A*x = Xx and B*x = 0 
for some complex number A . Then, x = 0: 

9. Pole placement test. 

Given a set of Ui,U2,U3, ,u n of n complex numbers there exists a state 

feedback gain K such that the eigenvalues of A + BK are Ui, U2, U3, , u n . 
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Pole Placement 

The 9th condition with the pole placement, we would use an input of 

u = Kx 

The state equation would change into 

x =Ax + BKx = (A + BK)x 

The reason why we might want to use the pole placement technique to move the eigen- 
values is because the eigenvalues determine the stability of the system. If a system has positive 
eigenvalues, the system will likely blow up. As a result, we want to move the pole to the nega- 
tive side of the complex plan. 



What does passing the controllability test imply? 
Let Xo, x f and T > 0 be given 

There are 2 very important facts you need to know. 

(once again, there are reasons why they work, but we will not cover it here) 

1. Xf — e AT Xo is in the controllable subspace 
Xf — e AT xo G Range(Q c ) 
since 

Range(Q c ) = Range(P c (T)) 
x f -e AT x 0 e Range(P c (T)) 
therefore, there must be a vector z where 

P c (T)z = x f - e AT x 0 

to find z we would use the equation 

z = P c (T)t(x f -e AT x 0 ) 
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2. If it is possible to get from xotoxf at a given time T the input u to get us there is: 
u(t)=B*e A "^ T -^ z , Vte[0,T] 



From these two very important facts, we see that that the input to get us from point A 
to point B is u. To solve a controllability problem is therefore as simple as solving for u. 



Now let's do an example together: 
Consider the model 




where co n = l and a = 1/10 

How would we go about finding a basis for the controllable subspace? 
Is the model controllable? 

What input can we use to get from xq to Xf in time = 1 second? 
What input can we use to get from xq to Xf in time = 5 second? 
What input can we use to get from Xq to x / in time = 10 second? 

Solution: 

To find the controllable subspace we must first find the controllability matrix. You can 
either calculate it by hand or use matlab. 

The command for matlab is ctrb(A.B) where A.B are part of the state equation. 

/ 0 0 20 \ 

ctrb(A,B) = o 20 -404 

\ 20 - 400 8000 / 
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From this matrix, we see that the basis of the matrix forms three independent dimensions, 
meaning that the subspace is just. 

(!!!) 

V o o 1 J 

By definition a system is controllable if the rank(A) of the (A,B) is equal to the dimen- 
sion of A. From seeing this matrix, we see that the dimension is 3 so this system is controllable. 

The next question we need to answer is "how" are we going to get from initial condition 
to the final condition. Let's answer the first part where time is equal to 1 second. 

From the previous discussion we know that the input is given by the equation: 

u(t)=B*e A *( T -^ z , Vi£[0,T] 
replacin z 

u(t) = B* e ^*( T -*) p c (T)t ( Xf - e AT x 0 ) Je At BBe At d t 
now if we replace P(T) 

u(t) = B* e ^*( T -*) ( / T e A * BBe At d t)t ( x f - e AT x 0 ) 

Yes, this really big and complicated equation is what we use to find the control input 
that would take us from the initial condition to the final condition. 



It would be a big task to solve the entire system by hand, so luckly we have matlab 
on our side. ( I am assumming that if you are reading this paper, you have done matlab before) 
Here is the code, made as simple as possible. 

w = 1; 
c = 1/10.0; 
xO = [0;0;0]; 
xf = [5;5;5]; 
n = 1; 
u=[] 

T = 1; %The time is 1 second 

t = 0:0.01:T; 

A = [0 1 0;-w2 -2*c*w 1:0 0 -20]; 
B = [0;0;20]; 

y = xf - exp(A*T)*x0; 
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P = ctrbgram(A,B,T); %We solve for P(T) here, ctrbgram is a pre-written function, I wil 

% include this function with this paper 

z = pinv(P)*y; 
for i = l:length(t) 

u(i) = B'*expm(A'*(T-t(i)))*z; 
end 

sys = ss(A,B,eye(3),xO); %We create a system using matrix A and B 

%By assigning matrix C to be identity, we are forcing 
% the output y to be the same and x . 
x = lsim(sys,u,t,xO) % Now we generate the output 

figure(l) 

plot(x(:,l),x(:,2)) % Here I have plotted out the first 2 state and how it approaches 

% (5,5) 

hold 

figure(2) 

plot(t,u,'r') %Here I have plotted out the input required for us to get there. 

% I have made the output color red to distinguish the two 
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for time T = 5 seconds 




Notice how all the blue lines end up at (5.5) position. This is the goal. Hopefully this 
paper can give you some help on this complicated topic. 
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